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Abstract 

In recent research in physics, formulation of general physical systems from operational viewpoints has 
attracted attentions with motivation to re-axiomatize and characterize quantum physics among those 
general physical theories. In those studies, convex sets and afBne maps between them are essentially 
used for describing physical systems. In the first part of this paper, we study some fundamental prop- 
erties of convex sets and affine maps that are relevant to the above subject. In contrast to most of 
the preceding related works, which considered compact convex sets only, our argument deals with non- 
compact convex sets as well. In the second part, we present a result on separation of simplices and balls 
(up to afhne equivalence) among all compact convex sets in two- and three-dimensional Euclidean spaces, 
which focuses on the set of extreme points and the action of affine transformations on it. Regarding the 
above-mentioned axiomatization of quantum physics, our result corresponds to the case of simplest (2- 
level) quantum system. We also discuss a possible extension to higher dimensions. 
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1 Introduction 

1.1 Backgrounds and our contributions 

Convexity is a ubiquitous notion in mathematics, frequently appearing not only in geometry but also in other 
various research areas, including many applications to outside mathematics (see e.g., [211 and references 
therein). Among them, a series of interesting studies on convexity have emerged from physics, in particu- 
lar quantum physics. These activities aim at interpreting quantum physics as an instance of more general 
physical theories (called e.g., "general probabilistic theories"), the latter being axiomatized from operational 
viewpoints, using "(physical) states" and "measurements" as the basic notions. Here, probabilistic mixture 
of states are formalized as convex combination of states, therefore the notion of convexity is essential in those 
studies. A motivation of studying such general theories is to establish a unified theoretical framework to 
describe quantum (and classical) physics together with its possible variants or generalizations. Potential ap- 
plications of such activities would include cryptography with long-standing security; if one wants to estimate 
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the security of present cryptographic schemes against attacks using physical devices in the next 100 years, 
where the present quantum physics may be improved by some advanced theory, then such an observation 
of general physical theories may be of some help. Another motivation is to characterize quantum physics 
among such general theories, giving a re-axiomatization of quantum physics based on physical principles, 
which is expected to be more physically intuitive than von Neumann's original axiom based (mysteriously) 
on Hilbert spaces. For more introduction to this subject from physical viewpoints and several preceding 
works, see e.g., [TJ |8l [131 [171 [19] and references therein. 

A common philosophy in the above-mentioned studies of general physical theories can be understood as 
follows: We put mathematical assumptions that are essential (or inevitable) from physical viewpoints, while 
the quantity of other "technical" assumptions should be as small as possible. To formulate the state space 
(the set of physical states) of such a general physical theory, the state space is conventionally assumed to be 
a convex set, reflecting the above-mentioned requirement that any probabilistic mixture of two states should 
also be a state. On the other hand, most of the preceding works on this subject adopted another assumptions 
that the state space is compact with respect to a certain physically reasonable topology and also is finite 
dimensional [31 [31 [TUl HO] ■ The first assumption of the compactness is physically guaranteed [T] as human 
beings cannot distinguish compact and non-compact state-spaces due to the existence of a finite accuracy 
of measurements. However, this does not mean that our world indeed has a compact state space, and thus 
it is still desirable to describe the general theories without this unnecessary hypothesis (at least from the 
mathematical point of view). The second assumption of the finite dimensionality of state space crucially 
restrict the theories for the description of physics — for instance, even a state space of a one electron has 
a infinite dimensional state space. The aim of the first part of this paper is thus to investigate the cases 
where the compactness or finiteness of dimension is not satisfied (while the part also includes some results 
on compact and/or finite-dimensional state spaces as special cases). 

Let us give a further explanation of the content of the first part. In the formulation of physical state 
spaces using convex sets, the notion of "dynamics" on physical systems can be formulated as afhne maps 
between convex sets in order to preserve the probabilistic mixtures. To study affine maps between two state 
spaces, we introduce compact closures of the state spaces and consider affine maps between the compact 
closures, as each of the former affine maps extends uniquely to some of the latter. Hence, if we deal with the 
set of affine maps as a plain set, there is no problem to assume the state spaces to be compact. However, 
when we define a topology on the set of affine maps like the compact-open topology according to the above- 
mentioned common philosophy, we do not want to use information on the boundaries of state spaces, which 
are introduced by just technical reasons. From this viewpoint, we introduce a notion of "essential" open or 
closed subsets of the compact closure of state space, which means (roughly) that the essential shape of the 
subset is not affected by the existence of the boundary of the state space (see Definition [4] for the precise 
definition). By using the notion of essential subsets, we introduce a topology, which is an analogy of the 
compact-open topology, on the set of continuous maps between the compact closures, into which the set of 
affine maps between the state spaces is naturally embedded (see Definition [5]) . This new topology also has 
desirable properties; for example, the induced topology on the set of affine maps between state spaces is 
Hausdorff (Proposition [2]), relatively compact in finite-dimensional cases (Proposition [5] and Proposition [6]), 
and compatible with natural algebraic operations and natural actions. The authors hope that this topology 
and the notion of essential subsets are not only physically reasonable but also of purely mathematical interest. 

In the second part of this article, we investigate finite-dimensional compact state spaces (convex sets) 
equipped with symmetry and some additional special properties. In the theory of convex polytopes, the 
notion of symmetry (precisely, vertex-transitivity of affine isometric transformation groups) has played one 
of the most significant roles and such symmetric convex polytopes have been intensively studied (e.g., |2]). In 
the studies of general physical theories, the symmetry property can also be considered as one of physical 
principles which can be interpreted as a possibility of reversible transformation between pure states [4] [TO] [20] 
or as a physical equivalence of pure states [TH[T7]. In this context, the characterization of state space under 
the symmetric hypothesis becomes highly an important subject as it gives a classification of general theories 
with respect to the symmetry property. In this article, we give the following characterizations on 2- and 
3-dimensional compact convex sets with the symmetry property: 
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Theorem 1. Let S be a compact convex subset of a Euclidean space with 2 -dimensional affine hull; Aff (5) = 
. Then the group of bijective affine transformations of S acts transitively on the set ScKt of extreme points 
of S if and only if S is affine isomorphic to one of the following two kinds of objects: 

1. A symmetric (or vertex-transitive) convex polygon. 

2. The (2- dimensional) unit disk. 

Theorem 2. Let S be a compact convex subset of a Euclidean space with "H- dimensional affine hull; Aff (5) = 
K'^. Then the group of bijective affine transformations of S acts transitively on the set iScxt of extreme points 
of S if and only if S is affine isomorphic to one of the following three kinds of objects: 

1. A i- dimensional symmetric (or vertex-transitive) convex polytope. 

2. A 3-dimensional circular cylinder {^{x,y, z) € M"^ | + < 1 , < z < 1}. 

3. The S- dimensional unit ball. 

Here we give a remark on a related work: hi a preceding article [6 , Davies also studied the finite- 
dimensional compact convex sets S whose groups G of bijective affine transformations act transitively on the 
sets of extreme points, and presented a classification of the convex sets S such that its group G of symmetry 
as above is equal to a given compact group, in terms of classification of finite-dimensional subspaces of the 
left regular representation of the given compact group. However, in that work any relation between the 
symmetric convex sets with different groups of symmetry, and also the concrete shape of a symmetric convex 
set induced by each subspace of the regular representation, have not been clarified. Therefore, to classify 
all symmetric convex sets based on that result, it is basically required to determine the concrete shape of 
every convex set constructed from some representation space of every compact group. On the other hand, 
our results above aimed at determining the symmetric convex sets without any restriction for the groups of 
symmetry. 

Next, we investigate another kind of physically motivated hypothesis of the distinguishably decomposablity 
of states. First, we remind the definition of distinguishability of states in a single shot measurement (see, 
e.g., |16j for its motivation from physical viewpoints): 

Definition 1. We say that points si,S2, . ■ . , Sn of a convex subset 5 of a real vector space are distinguishable 
if there exists a collection (e^)"^]^ of n affine functionals : 5 — > R such that > 0, X]r=i = 1 and 
ei(sz) — 1 for every 1 < i < n. 

Note that any non-empty subset of a set of distinguishable points is also distinguishable. Roughly 
speaking, if a convex set S has n distinguishable points si,...,s„, then "lossless" encoding of any n-bit 
information into a point of S is (in principle) possible by using these n points. (A geometric interpretation 
of this definition will be supplied in Lemma [TTl below . ] Then we introduce the following definition: 

Definition 2. Let 5 be a convex subset of a real vector space. We say that S is distinguishably decomposable 
if each s e 5 admits a decomposition s = X]j=i ^j^j (1 ^ ^ < c«) into distinguishable extreme points 

si, . . . ,se G 5ext such that X]j=i — 1 ^^'^ — for every j. Moreover, if the number £ of distinguishable 
extreme points in each decomposition is bounded above by fc, then we say that S is distinguishably k- 
decomposable. 

In general physical theories, the distinguishably decomposability of states can also be one of the physical 
principles which can be interpreted as the possibility of state preparation with a probabilistic mixtures of 
distinguishable pure states J/Tj- By using this notion, in this article we give the following enhancement of the 
above theorems, the latter of which separates (up to affine equivalence) the 3-simplex and the 3-dimensional 
ball among arbitrary 3-dimensional convex sets: 

Theorem 3. Let S be a compact convex subset of a Euclidean space with AS{S) = M^. Then the following 
two conditions are equivalent: 
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1. The set S is ajjine isomorphic to either a triangle (i.e., 2-simplex) or the unit disk. 

2. The group of bijective ajjine transformations of S acts transitively on Soxt, cind S is distinguishahly 
decomposable. 

Theorem 4. Let S be a compact convex subset of a Euclidean space with AfF(5) = M^. Then the following 
two conditions are equivalent: 

1. The set S is affine isomorphic to either a tetrahedron (i.e., 3-simplex) or the unit ball. 

2. The group of bijective affine transformations of S acts transitively on iSext, o-nd S is distinguishahly 
decomposable. 

Note that a classical probability theory is characterized by a simplex state space, while in 2-level quantum 
systems the state space is affinely isomorphic to a unit ball (called the Bloch ball; see e.g., [151 Thus, 
the result is physically important since we have shown that in 3-dimensional state space the physical theories 
are restricted to be either classical or quantum under the two physical principles of symmetricity and the 
distinguishahly decomposability [IT]- (See O IH [TOl [20] for another characterizations of the Bloch ball.) Here 
we emphasize that the dimension of a state space S is also (in principle) operationally determined. Indeed, 
for each positive integer n, we have dim(iS) < n if and only if every set {si, . . . , Sn+2} of n + 2 states in S is 
affinely dependent, the latter condition being testable by using (infinitely many) measurements on states in 
S (see Remark [T] below). Then we have dim(5) = n ii and only if every set {si, . . . , Sn+2} of n + 2 states in 
S is affinely dependent and there is a set {s'j^, . . . , sJi+i} of n + 1 states in S which is affinely independent; 
the condition is also (in principle) testable by measurements as mentioned above. Hence, the restriction of 
dimensions of the state spaces in our results can also be regarded as a possible "physical principle" . 

Remark 1. A finite set {si, . . . , s„} of states in S is affinely dependent if there exist two disjoint non-empty 
subsets /, /' of {1, 2, . . . , n} and non- negative coefficients pi for i € / and p'^ for i G I' with the property 
that J2ieiPi = 1 = J2iei'Pi ^^'^ (*) X^ig/K^i ^ 'l2iei'Pi^i- ^ow the latter condition (*) is testable by 
using (infinitely many) measurements on states in S, therefore the affine (in)dependence of states is also (in 
principle) experimentally testable. 

Finally, for higher (finite) dimensional cases, we also give the following result: 

Theorem 5. Let S be a finite- dimensional compact convex set with AS{S) — R", n < 00. Let G denote the 
group of bijective affine transformations of S. Then S is affine isomorphic to the n-dimensional unit ball if 
and only if the following three conditions are all satisfied: 

L The group G acts transitively on the set Scxt of extreme points of S. 

2. The diagonal action of G on the set of pairs (31,82) of distinguishable extreme points Si,S2 € Scxt is 
transitive. 

3. The set S is distinguishahly 2-decomposable. 

This result provides a new characterization of finite-dimensional solid ellipsoids among all convex sets in 
terms of structure of the set of extreme points. 

Moreover, in fact the authors have the following conjecture: 

Conjecture 1. The second condition in Theorem\^for the diagonal action of the group G would be redundant: 
The transitivity of G on extreme points and the distinguishahly 2- decomposability would characterize the affine 
isomorphism classes of finite- dimensional unit halls. 

By Theorems [3] and S] this conjecture is true for up to 3-dimensional cases. A study for a general 
finite-dimensional case will be a future research topic. 
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1.2 Notations and terminology 

Unless otherwise specified, in this article any vector space is considered over the real field R, and symbols 
S, Sq, Si, S2, ■ ■ ■ denote non-empty convex subsets of some vector spaces. The notation AfF(iS) signifies the 
affine hull of S. For any pair of topological spaces X and Y, let C{X, Y) denote the set of all continuous 
maps from X to Y. For any subset A C X,let mtx{A) and clx{A) denote the interior and the closure of 
A relative to X, respectively. When the underlying space X is obvious from the context, we instead write 
A° = intxiA), A = clx{A) and A'^ = X\A. 

1.3 Organization of the article 

This article is organized as follows. In Section [21 we summarize some basic definitions and fundamental 
properties relevant to convex sets, and introduce some notions for the study of non-compact convex sets. In 
SectionlH we study algebraic and topological properties of the sets of affine maps between convex sets; Section 
I3.1l deals with general (possibly non-compact and infinite-dimensional) cases and Section [3. 21 is specialized to 
finite-dimensional cases. Finally, in Section |4] we prove the theorems listed in Section ll.il some preliminary 
observations are provided in Section 14.11 and the bodies of the proofs are given in Sections I4.2H4.41 

2 Preliminaries 

For fundamental facts and terminology regarding topological spaces, we refer to |11] or Prerequisites in [24] . 
We refer to [21] for fundamentals of topological vector spaces. 

First, we introduce the following terminology, which has been used in the physically motivated preceding 
works on convex structures mentioned in Section [01 

Definition 3. We say that a convex set S is separated if for any distinct elements si,S2 G S, there exists 
an affine functional / : 5 — > M such that f{S) is bounded in M and /(si) 7^ /(S2). 

We notice that, when 5 is a convex subset of a finite-dimensional Euclidean space, S is separated if and 
only if S is bounded (see e.g., [71 Lemma 2.5.1 and Section 2.5, Exercise 1]). For an arbitrary convex set 
S, we define an equivalence relation on S such that two elements si,S2 € S are equivalent if and only if 
/(■si) — /(•S2) for every affine functional / : 5 — > K with bounded image f{S). Then the corresponding 
quotient set becomes a separated convex set, with essentially the same set of the bounded affine functionals 
as S. Owing to this fact, throughout this article, we suppose without loss of generality that any convex 
set denoted by the symbols Sq, Si, S2, ■ ■ ■ is separated unless otherwise specified. Now we present the 
following preceding result as the starting point of our argument, which says intuitively that any separated 
convex set has compact convex closure in the completion of the underlying vector space: 

Proposition 1 ( |231 Theorem 2.1]). For any (separated) convex set S, there exists a unique (up to isomor- 
phism) collection {S,V{S),V{S)) of objects with the following properties: 

• V{S) and V{S) are locally convex Hausdorff topological vector spaces such that V{S) is a dense subspace 
ofV{S). 

• S is a convex subset ofV{S) such that Aff(5) = V{S). 

• Let C denote the set of all continuous linear functionals on V{S). Then the weak topology on V{S) 
induced by the set C of mappings coincides with the original topology ofV{S). 

• The weak topology on V{S), induced by the set of all linear functionals f on V{S) such that J{S) C M 
is bounded, coincides with the original topology ofV{S). 

• The weak topology on S, induced by the set of all affine functions / : 5 — !■ [0, 1], coincides with the 
original topology of S (the subspace topology relative to V{S)). 
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• S = clyj.^j(5), S is convex, compact and complete, and Aff(5) ~ y{S). 

In what follows, we suppose that associated to each convex set S the objects S, V{S) and V{S) as in 
Proposition [1] and the induced topology on S are given. Note that V{S) — V{S) and S = S ii S is compact. 
On the other hand, if S is finite-dimensional, then V{S) = V{S) and it is a Euclidean space of the same 
dimension as S. 

We present two lemmas for later reference. The first one is the following: 
Lemma 1. Any continuous affine map / : iSi — > 52 extends uniquely to an affine map f : Si ~> S2, hence 

Proof. The uniqueness follows from the fact that Si = cl^^(5i) C V{S) is Hausdorff. For the existence, as 

Aff(5i) = ^^(^i), / extends to an affine map g : V{Si) — > V{S2)- Choose v e V{S2) such that g + v is a. 
linear map. Then g + v is continuous at a point in V{Si), namely any point in Si, therefore it is uniformly 
continuous on V{Si). As V{Si) contains V{Si) as a dense subspace, the map g + v extends to a unique 
continuous linear map h : V{Si) — ?> V{S2) (see e.g., Section III.l]). Now f = h — v : V{Si) — V{S2) is 
a continuous affine extension of /. This implies that f{Si) C ^2, therefore f{Si) C ^2 as Si — cl^^^^j(5i), 
52 is closed and / is continuous. Hence we obtain a continuous affine extension / f\g^ : Si ^ S2 of /. □ 

The second lemma below says intuitively that a closed subset C of an open set U will be still contained 
in U after a slight moving toward any point: 

Lemma 2. Let C and U be a closed subset and an open subset of S , respectively, such that C d U. Then 
for any x G S , there exists an m ^ (0, 1) such that Ax + (1 — \)y G U for every y G C and < A < m. 

Proof. First, as S is compact and Hausdorff, 5 is a normal space and C is compact. The Urysohn's Lemma 
implies that there exists a continuous map F : S [0,1] such that C C F^^(O) and W C F~^{1). Then 
the map (p : [0,1] x C [0, 1], (p{X,y) = F{Xx + (1 — X)y), is also continuous, as the operation of taking a 
convex combination of two elements in S is continuous. Note that {0} x C C (p^^(Q) C (p^^{[0, 1)), therefore 
for each y E C, there are relatively open neighborhoods ly C [0, 1] of and Wy C C of y, respectively, 
such that ly X Wy C (p^^{[0,l)). As C is compact, there are finitely many elements yi,...,yk S C such 
that C = lJi=i ^Vi- Now PliLi ly is a relatively open neighborhood of in [0, 1], therefore [0, m] C HiLi 
for some < m < 1. We show that this m satisfies the condition. Let y G C and < A < m. Then we 
have y G Wy. for some 1 < i < fc. Now {X,y) G /y. x Wy. and f{X,y) = F{Xx + (1 — X)y) < 1, therefore 
Aa; + (1 — X)y G U. Hence Lemma [2] holds. □ 

For two convex sets Si and ^2, let A{Si,S2) denote the set of aU affine maps / : 5i — >■ ^2. Then by 
Lemma[7]below, A{Si , 52) can be embedded into the set A'^{Ai , A2) of all continuous affine maps / : Ai — A2 
between compact sets, which would make the situation easier. However, if we endow the set A(Si,S2) with 
the subspace topology of the standard compact-open topology on ^^(^1,^2), then to determine the open 
subsets of A{Si,S2) we need to concern the behavior of (the extension of) a map / G A{Si,S2) at a subset 
of Si which may be even entirely outside the original set Si. To reduce such difficulty, here we define the 
notion of "essential" open or closed sets as follows, which means intuitively that the "essential shape" of 
such an essential open or closed set is not affected by pasting or detaching, respectively, the "skin" S\S oi 
the convex set S. Formally, we present the following definition: 

Definition 4. We say that an open subset O of 5 is essential if int^(0 U {S\S)) — O. On the other hand, 
we say that a closed subset C of 5 is essential if dg{C O S) — C. 

Here we show some basic properties of the essential subsets: 

Lemma 3. 1. A subset O of S is open and essential if and only if O"^ d S is closed and essential. 
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2. For any K C S which is closed in S, the set C = clg(K) is an essential closed subset of S and 

K^cns. 

3. For any U <Z S which is open in S, the set O = intgiU U S'^) is an essential open subset of S and 

u = ons. 

4- For a closed subset C of S , the following conditions are equivalent: 

(a) C is essential. 

(b) C = c\g{K) for some K <Z S which is closed in S. 

(c) C is the intersection of all closed subsets K of S such that K nS ~ C nS. 
5. For an open subset O of S, the following conditions are equivalent: 

(a) O is essential. 

(b) O = mig{U U 5^) for some U d S which is open in S. 

(c) O is the union of all open subsets U of S such that J7 U 5^ = O U 5"^. 

Proof. In the proof, we regard operations A° , A and A'^ as being relative to S. 
^ The claim follows from the relation {{OUS'^fY ^ (O U 5=)= = TFTVS. 

^ Choose a closed subset K' of S such that K ^ K' nS. Then we have K cKnS C (K'r\'S)r\S = 
K' nS ^ K, therefore K = KnS and K = KnS. Hence the claim holds. 

([3]) The fact that O is essential follows from the claims [1] and [21 Choose an open subset U' of S such that 
U = U'r]S. Then we have OnSc{UnS'')nS = U^U'nS, while U' C ([/' U S")" = {{U' ns)u 5'=)° = 
{UUS'')° = O, therefore OnS(lU = U'r\S(lOnS. Hence we have OnS = U, therefore the claim holds. 

^ The conditions (a) and (b) are equivalent by the definition and the claim [21 For the implication 
(a),( b) =^ (c), C = K satisfies that if K' is closed in S and K' n S = C n S, then C n 5 C K' and 
C = C O S C K' . Hence this implication holds. For the remaining implication (c) (a), the set K — C 
satisfies Kr\S = C{^S hy the claim [21 therefore CcCn5. AsCn5cC and C is closed, we have 
C n 5 = C, therefore this implication holds. Hence the three conditions are equivalent. 

([5|) By virtue of the claim [H the claim is derived from the claim [H by taking the complement (relative to 
S) of the sets appearing in each statement (note that for the condition (b), we have C"^ = K'^ = {K'^)° = 
(5^= U (5 \ K)Y, and f/ = 5 \ if is open in S). □ 

We also give the following two auxiliary results for later use: 

Lemma 4. Let O and C be an open and a closed subsets of S , respectively, such that O d C . Then there are 
an essential open subset O' and an essential closed subset C of S , respectively, such that O d O' <Z C G C . 
Moreover, this C' can be chosen to be convex if C is convex. 

Proof. First, put C — C f^ S , which is an essential closed subset (by Lemma[3]) and satisfies that C C C, as 
C n 5 C C and C is closed. If C is convex, then C H 5 is also convex, therefore its closure C" is also convex 
(see e.g., [211 Section II. 1, Theorem 1.2]). We show that O C C". Let x € O and W an open neighborhood of 
X. Put W = VFnO, which is also an open neighborhood of x. Then we have W C O C C, while W' OS ^ 
as S is dense in S. This im plies that 07^I^'n5 = W^'nCn5cVFnCn5, therefore W D {C D S) ^ . 
Hence we have x £ C D S — C , therefore O C C" as desired. For the remaining claim, by applying the 
above argument to the pair C O'^, we have C"^ C K C O'^ for some essential closed subset K, therefore 
O C if^ C C" and O' = K'^ is the desired essential open subset by Lemma [H □ 

Lemma 5. Let S G {5,5}. Then for any s Cz S and any open neighborhood U of s in S, there is a convex 
closed subset C of S and a convex open subset O of S such that s € O G C G U . Moreover, in the case S — S , 
this C can be chosen to be essential, and there is an essential open subset O' of S such that O G O' G C . 
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Proof. Recall that every open subset of R is the union of open intervals. First we consider the case S = S. 
By the property of the subspace topology on S relative to V{S) (see Proposition!!]), there are a finite number 
(say, k) of affine maps : 5 — [0, 1] and intervals C [0, 1], 1 < i < fc, such that li are relatively open 
in [0,1] and s £ PliLi f^^i^i) ^- Now each li is non-empty and the two endpoints of li are different 
(as li is relatively open in [0,1]), therefore li contains an interval Ji such that Ji is also relatively open 
in [0,1], fi{s) G Ji and the closure Ji of Ji relative to [0,1] is also contained in This implies that 
s e nti/r'(^0 C nti/r'(X) C nti/r'(^0 C U, whUe l^iJ,) is open and convex and fr\T,)Js 
closed and convex (as fi is continuous and afhne, and both Ji and Ji are convex), therefore C — HiLi fi^^{Ji) 
and O = HiLi fr^i'^i) satisfy the desired conditions. 

The proof for the case S = S is similar. By the property of the topology on V(S), there are a finite 
number (say, k) of continuous linear maps fi : V{S) — > M and open intervals C M, 1 < i < fc, such that 
s € S O Cli^i fi^^{Ii) C U. Now each li contains an open interval Ji such that fi{s) G Ji and Ji <Z U. This 
implies that s £ S C^ HiLi fr^i.Ji) C 5 H HiLi fi'^i'^i) C U, while f^^{Ji) is open and convex and f^^{Ji) 
is closed and convex by similar reasons. Therefore C = Sn flLi f~\Jt) and O = 5 n flLi fr^W satisfy 
that C is convex and closed, O is convex and open, and s £ O d C d U. The remaining claim now follows 
from Lemma [31 □ 



3 On the sets of affine maps on convex sets 

In this section, we study the structural properties of the set A{Si ,82) of affine maps from Si to 52 , especially 
its topological properties. 



3.1 General cases 

First, we notice that the set A{Si,S2) also admits a natural convex structure. Namely, for each f,g £ 
A{Si,S2) and A £ [0, 1], we have (A/ + (1 — X)g){s) = A/(s) + (1 — X)g{s) £ S2 for every s £ Si, therefore 
A/ + (1 — X)g £ A{Si, ^2). This convex structure is compatible with composition of maps, namely we have 

ho {Xf + {1 - X}g) = X{ho f) + {1 - X){ho g) , 

(A/ + (1 - X)g) oh' ^ X{f o h') + (1 - A)(.g oh') ^ ' 

for each f,g£ A{Si,S2), X £ [0, 1], h £ yl(52,53), and h' £ A{So,Si). Moreover, each map in A{Si,S2) is 
continuous, namely we have: 

Lemma 6. We have A{Si,S2) C C(5i,52). 

Proof. Recall from Proposition [T] that the topology oi Si (« = 1, 2) is the weak topology induced by the set 
A{S^, [0, 1]) of mappings. Let / £ A{Si,S2). Then for each e £ A{S2, [0, 1]), we have eo f £ A{Si, [0, 1]), 
therefore e o / is continuous. By the definition of weak topology, this implies that / is continuous. Hence 
the claim holds. □ 

By this lemma, when Si and 52 are compact (hence Si — Si and 52 — S2), the set ^1^^(51,52) of all 
continuous affine maps Si — )• ^2 coincides with A{Si,S2). 

Let A{Si,S2) denote the set of aU / £ ^^^(51,52) such that f{Si) C ^2. Then we have A{Si,S2) C 
A'^{Si,S2) C C(5i,52) by the definition, while we have A{Si,S2) — ^^^^(51,52) if ^2 is compact (i.e., 
52 =52). Now we have the following property: 

Lemma 7. Each f £ ^(5i,52) extends to a unique f £ v4(5i,52), and every element of A{Si,S2) is 
obtained from some f £ y^(5i,52) in this manner. 

Proof. By Lemma[T]and Lemma|6l each / £ A{Si , 52 ) extends to a unique continuous affine map / : 5i — > 52 , 
and we have /(5i) ~ /(5i) C 52. The remaining claim is obvious. □ 
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Hence the set A{Si,S2) can be identified via the map / / with the subset A{Si,S2) of A'^{Si,S2)- 
Note that A{Si,S2) also admits a natural convex structure, as f,g G A{Si,S2) and A € [0, 1] imply that 
A/ + (1 — A)^ € A{Si , S2) (for the continuity of A/ + (1 — X)g, note that f,g and the operation on Si taking 
a convex combination of two elements are all continuous). By virtue of the uniqueness property in Lemma 
[71 this convex structure and the correspondence / 1^ / are compatible with convex structure on A{Si,S2), 
composition of mappings and some relevant objects. Precisely, the following properties hold: 

• Eh = Xf + {1- X)g, f,ge A{Si,S2), then we have h = A/ + (1 - A)^. 

• If / e A{Si,S2), g e A{S2,S3) and h — gof^ then h — go f. 

• We have hj^ {Xf + (1 - A)^) = X(h o /) + (1 - X){h o g) for any f,ge A{Si,S2), X G [0, 1] and 

h€A{S2,S3). 

• We have (A/ + (1 - X)g) oh = X{foh) + {l- X){g o h) for any /,g e A{Si,S2), X € [0, 1] and 

heAiSo,Si). 

• We have ids = idj^, where idx denotes the identity map on a set X. 

• If g e A{S2,Si) is aright (resp., left) inverse of / G A{Si,S2), namely fog — idg^ (resp., gof = id^J, 
then g g A{S2,Si) is a right (resp., left) inverse of / e y^(5i,52). Hence if / G y^(5i,52) is invertible, 
then / G A{Si,S2) is also invertible and /^^ = f^^. 

From now, we define topologies on the sets A{Si,S2) and A'^{Si,S2) which are analogy of the standard 
compact-open topology, by using the notion of essential subsets in Definition 2] 

Definition 5. First, we define the topology on the set C{Si,S2) to be the topology generated by the family 
B{Si,S2), referred to as the subbase of the topology, of all subsets of the form 

OK,u = {feC{Si,S2)\f{K)cU} (2) 

such that K is an essential closed (hence compact) subset of Si and U is an essential open subset of ^2 (see 
Definition m for the terminology). Namely, the open subsets of C{Si,S2) are the arbitrary unions of finite 
intersections of members Ok,u of B{Si,S2)- Then we define the topologies on ^"^(51,52) and A{Si,S2) to 
be the subspace topologies relative to C(5i,52), and define the topology on A{Si,S2) to be the topology 
induced from A{Si,S2) via the bijection / i— >■ / given by Lemma [71 

For simplicity, when we are focusing on the set A'^{Si^S2) rather than C{Si,S2), we abuse the notation 
to write Ok,u instead of Ok,u H A'^{Si,S2) unless some ambiguity occurs. It is trivial from the definition 
that this topology coincides with the compact-open topology when both Si and 52 are compact (i.e.. Si — Si 
and 52 = 52), as every open or closed subset is essential in this case. On the other hand, the definition 
suggests that the above topology would be in general weaker than the compact-open topology, as not every 
open or closed subset is essential. Nevertheless, the following two properties still hold: 

Proposition 2. The topological space C{Si,S2) is Hausdorff, hence so are A'^{Si,S2) and A{Si^S2). 

Proof. Let /, g G C(5i,52), f g- Then we have f\s^ 7^ 9\sn as Si is dense in Si and ^2 is HausdorfF. 
Choose an s G 5i such that /(s) 7^ g[s)- As ^2 is Hausdorff, we have UiC\U2 = for some open neighborhoods 
Ui,U2 in ^2 of f{s),g{s), respectively. By Lemma [SI Ui and U2 can be chosen to be essential, while the 
set K = {s} is closed and essential. This implies that / G Ok,Ui ^ l3{Si,S2), g G Ok,U2 ^ B{Si,S2) and 
Ok,Ui ^ Ok,u-2 = 0- Hence C{Si, S2) is Hausdorff, as desired. □ 

Proposition 3. Suppose that Si is compact, hence Si = Si. Then the topology on A{Si,S2) defined above 
coincides with the compact- open topology. 
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Proof. In this situation, we have f — f for every / G A{Si,S2), therefore A{Si,S2) — A{Si,S2)- Now for 
each K C Si — Si and each [/ C ^2 , we have 

OK,unA{Si,S2) = If € A{Si,S2) I f{K) c U} 

= {feA{Si,S2)\fiK)cUnS2}. ^' 

As the set U nS2 runs over all open subsets of ^2 when U runs over all essential open subsets of iS2 (see Lemma 
[SHS])), the above relation implies that the subbase of the compact-open topology on A{Si,S2) coincides with 
the subbase of the topology on A{Si,S2) defined above. Hence the claim holds. □ 

For the inclusion relations of the specified sets of mappings, we have the following three properties: 

Lemma 8. 1. The subset A'^ {Si, S2) of C{Si, S2) is closed in C{Si,S2)- 

2. The subset A{Si,S2) of C{Si,S2) is closed with respect to the compact-open topology on C'{Si,S2)- 

Proof. To deal with the two claims in parallel, put {Si,S2) = {Si,S2) and {Si,S2) = {Si,S2) in the case of 
claim [Hand claim [21 respectively. Let / £ C{Si,S2) which is not affine. It suffices to show that there is an 
open neighborhood O of / in C{Si,S2) such that each g G O is not affine. First, we show that f\s-^ is not 
affine. Assume for contrary that f\si is affine. Then by Lemma[Tl f\s^ extends to a continuous affine map 
/' : 5i — > ^2. Now note that / and /' are continuous. Si is dense in Si, and 52 is Hausdorff. Then it follows 
that f = f, a contradiction. Hence f\si is not affine, therefore there are three elements si, 82,83 G Si and 
a A G [0, 1] such that S3 = Asi + (1 - A)s2 but /(sg) A/(si) + (1 - A)/(s2). 

As ^2 is Hausdorff, there are open neighborhoods Vi of /(sa) and V2 of A/(si) + (1 — A)/(s2), respectively, 
which are disjoint. Moreover, as the operation of taking a convex combination in ^2 is continuous, there 
are open neighborhoods Wi of /(si) and W2 of /(S2), respectively, such that Xti + (1 — A)t2 G V2 for every 
ti G Wi and t2 G W2. In the case of claim [TJ Lemma [S] implies that these open neighborhoods Vi, Wi and 
W2 can be chosen to be essential. 

Now let O be the intersection of the three members 0^si}.Wi, O^S2},W2 ^-^d '^{33}. Vi of the subbase of 
the topology on C(5i,52). This O is an open neighborhood of / in C{Si,S2). li g G O, then we have 
gisi) G Wi, g{s2) G W2 and 3(53) G Vi, therefore \g{si) + (1 — A)sr(s2) G V2 by the choice of Wi and W2, 
and g[sz) ^ Ag(si) + (1 — \)g{s2) by the choice of Vi and V2. Hence each 5 G O is not affine, concluding the 
proof of Lemma [8] □ 

Remark 2. More strongly, if Si is compact, then Lemma[8]and Proposition[3]imply that A{Si,S2) is a closed 
topological subspace of C{Si,S2) with respect to the compact-open topology. 

Lemma 9. 1. The subset of all surjective maps in ^"^(51,52) is closed in A'^{Si,S2). 

2. If Si is compact, then the subset of all surjective maps in A{Si,S2) is closed in A{Si,S2). 

Proof. We prove the two claims in parallel. Let / G ^^^(51,52) (resp., / G A{Si,S2)) which is not surjective. 
Then f{Si) (resp., f{Si)) is a proper and compact subset of ^2 (resp., ^2), therefore its complement in 52 
(resp., S2) is open and non-empty. By Lemma [Sj there are a closed subset C and an open subset W of 
S2 (resp., 52), respectively, such that 9 ^ W C C and C C f{SiY (resp., C C f{SiY), therefore we have 
f{Si) (Z C W C §2 (resp., f{Si) C (Z W C S2). Now we choose a subset U of W as follows: 
In the case of the claim [21 we put U = C^; while in the case of the claim [TJ by virtue of Lemma [Jj we 
choose an essential open subset U of ^2 such that C^cUc W^. Then we have f{Si) C U C. S2 (resp., 
f{Si) C U C S2), therefore the member Og^ jj (resp., Osi,u) of the subbase of the topology on ^^^(51,52) 
(resp., A{Si,S2)) is an open neighborhood of / in A'^{Si, S2) (resp., A{Si,S2)) (this follows from Proposition 
[31 for the claim [21 and from the fact that Si = Si is essential for the claim [TJ. Moreover, each element g of 
Og JJ (resp., Osx,u) is not surjective, as we have g{Si) C U C S2 (resp., g{Si) C ?7 C 52). Hence the claim 
holds. □ 
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Proposition 4. // intyj.^^^ (52) 7^ 0; then the subset ^"^(51,52) of all continuous ajjine maps / : 5i — > ^2 is 
dense in A'^{Si,S2)- Hence A{Si,S2) D A'^{Si,S2) is dense in A'^{Si,S2)- 

Proof. Let OKi,Ui {\ < i < k) he members of the subbase of the topology on ^"^(51,52) such that O = 
[ti=iOK,,u, ^ 0- We show that OnA''{Si,S2) ^ 0. Choose / € O and a; e int^^^^^ (52). By applying 
Lemma [5] to each pair f{Ki) C Ui (note that f{Ki) is compact as well as Ki), there exists an m € (0, 1) 
such that Aa; + (1 — A)?; e Ui for every 1 < i < k, y f{Ki), and < A < m. Now we define a map 
(7 : 5i — > 52 by g{s) — mx + (1 — m)/(s) (s G Si). Then g is affine and continuous as well as /. For each 
s e iSi, we have f(s) £82 — c\y^g^^{S2) and < m < 1, therefore it follows from [211 Section ILl, Theorem 

1.1] that mx + (1 — m)f{s) E S2. Hence g £ A'^{Si,S). Moreover, for each 1 < i < k and s e Ki, we have 
f{s) £ f{Ki) and g{s) ~ mx + (1 — m)f{s) £ Ui by the choice of m. This implies that g £ O, therefore 
g £ O n A'^{S 1,82) as desired. Hence the claim holds. □ 

The next lemma says that any convex set S and its closure S can be identified with the sets A{*,S) 
and A''{*,S) = A{*,S), respectively, where * denotes the convex set with just one element, hence several 
properties of convex sets can be immediately derived from those of the sets A{Si,S2). 

Lemma 10. For each s £ S (resp., s £ S), let ts denote the map * — ^ 5 (resp., * — iSj given by /,s(*) = s. 
Then the map : 5 — > A{*^S) (resp., if : S ^ A'^{*,S)), f^s) = is, is an affine homeomorphism. 

Proof. First we consider the case of 5. Note that ig £ A^{*,S) for each s £ therefore Lp is well-defined. It 
is obvious that is afiine and bijective. Moreover, for each member 0*,c/ of S(*,iS), we have ip~^{0^,^u) = U 
which is open in 5, therefore is continuous. As S is compact and is Hausdorff (by Proposition 

[2]), a famous theorem in general topology implies that iy9 is a homeomorphism, as desired. 

Secondly, we consider the case of S. We have — ig for every s £ therefore y^(*,5) is naturally 
regarded as a subset of Now the map S — > under consideration is bijective and it is the 

restriction to iS of the map S — .A^(*, S) specified in the statement. Hence the former map is also afiine and 
homeomorphic, concluding the proof of Lemma [TUl □ 

Let A*{Si,S2) (resp., A''*{Si,S2)) denote the set of all / £ A{Si,S2) (resp., / £ A''{Si,S2)) which is 
bijective. From now, we show that the topology defined above is compatible with several operations and 
objects relevant to the sets of affine maps: 

Lemma 11. The map if : [0,1] x A%Si,S2) >^ A''{Si,S2) A''{Si,S2) defined by (p{XJ,g) = A/ + (l- A).g 
is continuous. Namely, the operation of taking convex combination of two maps is continuous with respect 
to the above topology. 

Proof. It suffices to show that (p~-^{Ok,u) is open for every Ok,u G B{Si,S2). Let A £ [0,1] and f,g £ 
A''{Si,S2) such that •f{\,f,g) £ Ok,u- Then we construct an open neighborhood O of (A,/, 5) such that 
O C ip^^{Ok,u), in. the following manner. 

For each s £ K, we have A/(s) + (1 — A)f;(s) — (f{X, f, g){s) £ U. As the operation of taking a convex 
combination of two elements in ^2 is continuous, there are an open neighborhood Is C [0, 1] of A and open 
neighborhoods Vj C ^2 of f{s),g{s), respectively, such that ^t-f + (1 — fi)t^ £ U for every fi £ Is, 
tf £ V/ and ta £ . By Lemma El these V/ and Vf can be chosen to be essential. By Lemma [5l again, 
there are closed subsets , of ^2 and open subsets ,W^ of ^2 such that /(s) £ C C Vj and 
gis)£Wi CN! CVS. ^ ^ ^ 

Now the map f x g : Si S2 ^ S2 defined by (/ x g){x) — {f{x), g{x)) is continuous as both / and g are 
continuous, therefore (/ x g){K) is compact in ^2 x ^2 as K is compact. On the other hand, {W/ x W^}s^k 
is an open covering of (/ x g){K) by the choice of W/ and Wf. This implies that there are finitely many 
elements si,...,Sk£K such that (/ x g){K) C U,=i(W^/, x W^J- We write iv/ = N^, Nf = Nl, v/ = V/^, 
and Vf = VS for simplicity. Now we have s, £ f-^{W/) C f~^{Nl) and Si £ g-^{Wf) C g-^{Nf), 
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therefore Lemma H huphes that we have f~'^iWl) C mJ C f~'^{Nl) and 5"HW^f) C Mf C g~'^iN[) for 
some essential closed subsets Af/ and Mf . We define 

A; 

O = fl X 0,,f yf X OM^,vf) ■ (4) 

4=1 

Note that Oj^^/ yf and OM'',y'' ^re members oi B{Si,S2), therefore O is an open neighborhood of (A, /, g) 

in [0,1] X A^{Si,S2) X ^^(5i,52). 

We show that (^(O) C Ok,u- Let {lJ-,f',g') G O- Then for each s G i^, there is an index i such that 
{f{s),g{s)) eW/x Wf, therefore s e f'^iw/) C m/ and s G ff"^(W:f) C Mf. Now we have G I,^, 
f'{s) G V^'^ and g'{s) G V^^, therefore ^jlJ'{s) + (1 — fJ-)g'{s) G U hy the property mentioned in the second last 
paragraph. This implies that ip{fi, f , g'){K) C U, therefore ip{fi,f',g') e Ok,u, as desired. Hence the proof 
of Lemma [TT] is concluded. □ 

Lemma 12. The map ip : A'^{Si,S2) x ^^(52,53) A'^iSijS^) defined by y:>{f,g) = g° f is continuous. 
Namely, the operation of composing two maps is continuous. 

Proof. It suffices to show that ^^^{Ok,u) is open for every Ok,u G B{Si,S2). Let / e ^^^^(51, and 
g G ^^^(52, 53) such that g o f £ Ok,u- Then we have f{K) C g^^{U) C 52, while f{K) is compact 
(as K is compact) and g^^{U) is open. Now for each s £ K, Lemma [5] (applied twice) implies that 
there are open subsets Fs,W^s of ^2 and closed subsets Ms,Ns of ^2 such that Vg is essential and /(s) G 
Ws C Ns C Vs C Ms C g~^{U). As f{K) is compact, there are finitely many elements si,...,Sk G K 
such that f{K) C Uti^s.- Write = Ws,, N, = Ns,, = Vs,, and M, = Ms,. Now we have 
Si £ f~^{Wi) C f^^{Ni), therefore Lemma H] implies that there is an essential closed subset N^ such that 
f~^{Wi) C N- C f~^{Ni). Moreover, we have Vi C lJi=i therefore Lemma|3]implies that there is an 
essential closed subset M' such that lJi=i C M' c Ui=i ^^i- ^ow put Of — PliLi ^N'^i and Og = Om'.u- 
Note that O/ and Og are open neighborhoods of / and g, respectively. We show that (p{Of x Og) C Ok,u- 
Let /' G Of and 5' G Og. Then for each s G if , there is an index i such that s G /~^(W^i)- Now we have 
s G TV/, therefore /'(s) G C M' and g'if'is)) G t/. This implies that g'{f'{K)) C therefore we have 
fif'^g') ^ g' ° f ^ Ok,u, as desired. Hence the claim holds. □ 

Corollary 1. The evaluation map ^^^^(51,52) x 5i — ?> 52, (/, s) /(s), is continuous. 

Proof. This follows from Lemma [T^ and Lemma [TUl □ 

Lemma 13. The map ip : A"{Si,S2) — > A"{S2,Si), yy{f) = f^^, is a homeomorphism. Namely, the 
operation of taking the inverse of a map is homeomorphic. 

Proof. First, for each / e A'^*{Si,S2), is also an affine map, while / is a homeomorphism as / is 
a continuous bijection from the compact Si to the Hausdorff 52. Hence we have /^^ e ^'^*(52,5i) and 
if is well-defined. Note that </? is obviously a bijection. To prove that ip is continuous, we show that 
ip-^{0K,u^A<'*{S2,Si)) = Oc/e,K^n^=*(5i,52) for every Ok,u G ^(52,5i) (note that Oc/^i^<^ G B{Si,S2), 
as is closed and essential in Si and is open and essential in ^2 by Lemma [3]). Indeed, for every 
g G Ok.u n ^'^*(52,5i), we have g{K) C U, therefore g^^iW^) C K'^ and g~^ G Ow^K" as 5 is a bijection. 
This implies the inclusion C, and the other inclusion D holds similarly. Therefore Lp is continuous, and the 
same argument shows that ip~^ is also continuous. Hence 93 is a homeomorphism, as desired. □ 

Corollary 2. The set A*{S,S) (resp., A'^*{S,S)) forms a topological group with map composition as mul- 
tiplication, and this group acts continuously on S (resp., S) by f ■ s = /(s) for each f G A*{S,S) (resp., 
f G ^"(5, S) ) and seS (resp., seS). 

Proof. This follows from Lemma [121 Lemma [T3l and Corollary [T] □ 
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Finally, we discuss the following sort of "coordinate expressions" of afBne maps. We choose and fix 
any (possibly infinite) subset B C Si, and define an affine map lb from A{Si,S2) (resp., A''{Si,S2)) to 
the set 82^ (resp., ^2^) of all mappings B ^ S2 (resp., B — )• by 6b(/) = /|_b, / € A{Si,S2) (resp., 
/ e A'^{Si,S2))- Note that lb is injective if Si C Aff(i3) (see Lemma[T]). Now the set (resp., ^2^) 
admits a natural topology that is the weakest topology to make, for every b B, the "evaluation map" 
evf, : 52^ 9 / f{b) € ^2 (resp., evj, : ^2^ 3 / f{b) £ S2) continuous. This topological space is nothing 
but the direct product space of copies of ^2 (resp., ^2) over b & B, therefore 52^^ (resp., ^2^) is Hausdorff 
as well as ^2 (resp., 52). By the Tychonoff's Theorem, 52'^ is compact, while 52'^ is compact if (and only 
if) 52 is compact. Now we have the following property: 

Lemma 14. Under the above setting, the map lb is continuous. 

Proof. First, we prove that lb '■ -^^(^i, ^2) -^82^ is continuous. It suffices to show that for each b G B, the 
composite map ipb = evf,o lb : ^"^(51,52) — >• 52 given by ^Pb(f) = f{b) is continuous. Now by Lemma[Sl each 
open subset of ^2 is the union of essential open subsets U of ^2, and we have ip^^{U) — O^^y^u e B{Si,S2) 
for any such U (note that {b} C B C Si, therefore the closed subset {6} is essential). This implies that ipt, 
is continuous, as desired. 

Secondly, for the map lb ■ A{Si,S2) — > ^2^, this map is the composition of the continuous map 
A{Si,S2) —7- ^^^(51,52), f ^ f given by Lemma [3 followed by the continuous map A'^{Si,S2) 82^, 
f ^ I\b studied in the previous paragraph. Hence lb is also continuous. □ 

3.2 Finite-dimensional cases 

In this subsection, we study the case of finite-dimensional convex sets and give some enhancements of the 
above general results. First note that, if dim(iS) = n < 00, then the locally convex Hausdorff topological 
vector space V{S) is naturally identified with the n-dimensional Euclidean space R", we have V{S) — V{S), 
and S is the closure of S in V{S) — M". Now we have the following three properties for inclusion relations 
of the sets of affine maps: 

Lemma 15. Suppose that dim(5i) < 00. 

1. If A" {61,62) 7^ 0, then we have dim(5i) — dim(iS2), every surjective map in A'^{6i,62) is a bisection, 
and A" {61,62) is closed in A'^ {61,62) ■ 

2. If A* {61,62) 7^ 0, then we have dim(iSi) = dim(52) and every surjective map in A{6i,62) is a bijection. 
Moreover, if 61 is compact, then A*{6i,62) is closed in A{6i,62). 

Proof. We prove the two claims in parallel. First note that V{6i) = V{6i) by the assumption. Take an 
/ e A'^*{6i,62) (resp., / € A*{6i,62)). Then, as the affine hulls of 61 and 52 (resp., 61 and ^2) are the 
whole underlying spaces, the maps / and g = f^^ extend uniquely to affine maps / : V{6i) — ?> V{62) and 
g : ¥{62) V{6i) (resp., / : V{6i) ¥{62) and g : ¥{62) V{6i)), respectively. Now we have gof = 
idy(5i), both of the two maps in the left-hand and the right-hand sides are affine extensions of go f = idj^ 
(resp., go f = ids^). Similarly, we also have f og = id^^^^^ (resp., f og = idy(52)). Therefore V{6i) and 
¥{62) (resp., ¥{62)) are affine isomorphic, hence dim(52) = dim(5i) < 00 (resp., dim(52) = dim(5i) < 00). 
This implies that dim(52) = dim(52) and ^(^2) = ¥{62), therefore dim(52) = dim(52) = dim(5i). Now 
each surjective h g ^^^(51,52) (resp., h G A{6i,62)) extends to an affine map h : V{6i) — >■ ¥{62), which 
is also surjective as the image of h is convex and contains ^2. As V{6i) and ¥{62) have the same finite 
dimension, this surjective affine map h is also injective, so is h (hence h is bijective). Finally, the remaining 
part of the claim now follows from Lemma [5] □ 

Corollary 3. Suppose that dim(5) < 00. Then the topological group A'^*{6,6) is closed in A''{6,6). 
Moreover, if 6 is compact, then the topological group A* {6, 6) is closed inA{6,6). 
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Proof. This follows immediately from Lemma [T5] □ 

Proposition 5. //dim(52) < oo, then both ^"^(51,52) and A{Si,S2) are dense in A'^{Si,S2). 

Proof. Under the assumption, V{S2) — ¥{82) is a finite-dimensional Euclidean space such that Aff(52) = 
¥{82), therefore inty^^^^{S2) 7^ (see e.g., [3 Proposition 2.1.7]). Hence the condition in Proposition S] is 
satisfied, therefore the claim follows from Proposition H) □ 

When S is finite-dimensional, let dg denote the Euchdean metric on V{S) = V{S) = M^'™^'^). Then 
iS is a compact (hence complete) metric space with respect to ds. Now if both Si and ^2 are finite- 
dimensional, then the set C(5i,52) is also a complete metric space with respect to the metric doo defined by 
doo(/, 9) = sup^gj^ ds2 (/(s), <?(s)) for f,g£ C(5i, ^2). (In fact, for each pair (/, g) the supremum is attained 
by some s £ Si, as. the function s {f{s),g{s)) is continuous on the compact space Si.) For any sequence 

in C(iSi, 52), convergence with respect to the metric doa is equivalent to the uniform convergence of mappings 
over Si. Note that the topology on C(5i,52) determined by doo coincides with the compact-open topology 
(see e.g., [TTl Section c-20.5]). To avoid confusion, we write Cd^ (5i, ^2) to signify the set C(5i, ^2) endowed 
with the topology determined by doo rather than the original topology defined in Definition [5l Note that 
the topology of C(5i,52) is weaker than or equal to that of Cd^(5i,52), while these are equal if both iSi 
and 52 are compact. Now we have the following fundamental result: 

Proposition 6. // both Si and S2 are finite- dimensional, then the topology on ^^^(51,52) coincides with 
the topology determined by the metric doo (or equivalently, the compact-open topology), and ^^"^(51, 52) is 
compact. 

The key fact for the proof is the Arzela-Ascoli Theorem (see e.g., [11] Section c-20.6]). The statement of 
the theorem relevant to our present situation is the following (note that the other condition for "boundedness" 
is now automatically satisfied, as the metric space 52 is compact): 

Theorem 6 (Arzela-Ascoli). A subset T of Cd^{Si,S2) has compact closure if and only if T is equicon- 
tinuous, i.e., for any s £ Si and any e > 0, there exists an open neighborhood U of s such that for every 
f £ T , we have ds2{f{s), f{t)) < s whenever t £ U . 

Proof of Proposition^^ First, we prove that the set — A'^{Si,S2) is compact with respect to the metric 
doo. Note that the subset T is closed in Cd^{Si,S2), as T is closed in C{Si,S2) by Lemma [8] and the 
topology on Cd^{Si,S2) is stronger than (or equal to) that on C{Si,S2). Therefore, by Theorem [51 it 
suffices to show that T is equicontinuous. Let sq G Si and e > 0. Choose si,...,s„ £ Si such that 
{so, . . . , Sn} is affine independent and its affine hull is V{Si). Then for each s G Si, there exists a unique 
expression s — sq = Yl^=i Ai(s)(si — sq) with Ai(s) S M. Note that every Ai is a continuous function on Si, as 
any exchange of coordinate systems in a finite-dimensional Euclidean space is a continuous operation. Now 
let U be the set of all s & Si such that cj^i < £, where c = sup^ ds^it^i') < 00 (the finiteness of 

c follows from the compactness of ^2). Then U is open as every Ai is continuous, and sq £ U as Ai(so) — 
for every i. Moreover, for each f £ J- and s G C/, we have 



(5) 



therefore f{s) - /(sq) = J2i ^■iis){f{si) - /(sq))- This implies that 

d5.(/(s),/(so))<El^^(*)M<s.(/(s.),/(so))<cElA»(s)|<£ . (6) 

i i 

Hence is equicontinuous, therefore is compact with respect to the metric doo- 
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Let (/? denote the identity map on the set C{Si,S2), which is regarded as the map between topological 
spaces ip : Cd^{Si,S2) — >■ C(5i,iS2). This map ip is continuous, as the topology of Cd^{Si,S2) is stronger 
than (or equal to) the topology of C(5i, 52). Now J" = A'^{Si,S2) is Hausdorff with respect to the subspace 
topology relative to C{Si,S2) (Proposition [5]) , while is compact with respect to the metric c?oo as above. 
This implies that the restriction (^jjr : — > of to is a homeomorphism as the domain is compact 
and the range is Hausdorff, therefore the two topologies on coincide with each other. Hence Proposition 
m holds. □ 

As an application of this result, we study the continuous map lb ■ ■A'^{Si,S2) -^82^ discussed in Lemma 
[T4l Let i? be a subset of Si such that Si C Aff(i3), hence lb is injective. Suppose that both Si and 52 are 
finite-dimensional. Then we have the following: 

Corollary 4. Under the above setting, the continuous map lb '■ -4'^(iSi, 52) — >■ 52^ is a homeomorphism 
onto its image. 

Proof. Now A'^{SitS2) is compact by Proposition |6l while 52^ is Hausdorff. Hence the continuous injection 
tB is a homeomorphism onto its image. □ 

In particular, when we choose a finite subset B as above, the space 52^ is a topological subspace of a 
Euclidean space (of finite dimension dim(iS2)|i3|), and its Euclidean metric transferred to the set A'^{Si^S2) 
via the above map lb and the metric dao determine the same topology on A'^{Si,S2), hence on A{Si,S2)- 

Remark 3. Here we give a remark on Lemma [9l This lemma will fail when we replace "surjective" with 
"injective" in the statement. Indeed, in the case Si ^ S2 = [0,1], we define fi{x) — x/i [x G [0,1]) for 
integers i > 1. Then each fi is affine and injective, while their limit / = with respect to the metric doo is 
not injective. 



4 On characterizations of solid ellipsoids 

In this section, we restrict our attention to the finite-dimensional cases, and discuss some characterizing 
properties of the unit balls up to affine equivalence mentioned in Section fl.il In what follows, let iSoxt denote 
the set of extreme points of 5, and write Aut(5) = y^*(5,5). 



4.1 Preliminary observations 

First, by the results of Section [3l the topological group Aut(5) acts continuously on S as bijective affine 
transformations, therefore this action preserves the subset S^xt- Now we have the following fundamental 
property: 

Proposition 7. Suppose that S is compact, dim(5) < 00, and Aut(5) acts transitively on Scxt- Then Scxt 
is a compact (hence closed) subset of S . 

Proof. Now the Aut(iS)-orbit of any given sq G iSext coincides with the whole 5cxt, therefore the compactness 
of iSext follows from the compactness of the group Aut(iS) in A{S,S) (by Lemma [TSl and Proposition [6]) and 
the continuity of the Aut(5)-action. □ 

Note that Scxt is not always a closed subset of S\ see e.g., [3 Section 2.4, Exercise 2]. 

Remark 4. When S is finite-dimensional, we say that a point s € 5 is exposed if the set {s} forms a face of 
S. In the current setting, this is equivalent to that there is an affine functional / : 5 R such that f{S) is 
bounded and s is the unique point in S to attain the maximum value of /. Any exposed point in S is also an 
extreme point in S, and the action of Aut(iS) also preserves the set of the exposed points. In general, it does 
not hold that every extreme point is exposed (see e.g., [7, Section 2.4, Exercise 2]). However, every extreme 
point is exposed if 5cxt 7^ (^-g-, if S is compact) and Aut(5) acts transitively on 5oxt- Indeed, it is known 
that the set of exposed points in S is dense in 5cxt (see e.g., [Tj Theorem 2.4.9]); in particular, an exposed 
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point exists in this case. Let sq be an exposed point in S, therefore sq S 5oxt- Then the Aut(5)-orbit of 
So consists of exposed points, while this orbit coincides with Scxt by the transitivity assumption, therefore 
every s € 5ext is exposed as desired. 

If S is compact and finite-dimensional, then Aut(5) is a compact group, therefore Aut(5) admits the 
(normalized) Haar integral f{g) dg (where we put G = Aut(5)) of continuous real functions / which is 
invariant under both left- and right-translations (see e.g., [H]). By using the Haar integral, it has been shown 
in [6l Lemma 1] that such a convex set S has a unique fixed point of the action of Aut(5). (For readers' 
convenience, in the Appendix we summarize a proof of this fact based on the existence of left-invariant 
integral for real-valued continuous functions on compact groups.) From now on, by choosing an appropriate 
coordinate system of V{S), we assume without loss of generality that the fixed point is the origin of the 
vector space V{S). In this setting, the group Aut(5) acts on S as bijective linear transformations, which 
extend uniquely to bijective linear transformations on V{S). Moreover, the next lemma implies that the 
origin of V{S) is now an interior point of S: 

Lemma 16. Suppose that S is compact and finite-dimensional, and Ant{S) acts transitively on Sa^t- Then 
a fixed point s Cz S of the Aut{S)-action satisfies that s G inty(5)(5). 

Proof. Assume for contrary that s G dS. Let H C V{S) be a supporting hyperplane of S at s. As H is 
convex and H C V{S) — Aff(5), we have iSext H. Choose a point t S Scxt \ H- On the other hand, 
choose a convex decomposition s = X]i=i ^i^i ^ i^^o extreme points Si e iSext such that A.; > for every 
i. Then by the assumption on the Aut(5)-action, we have /(si) — t for some / G Aut(5). Now we have 
s = f{s) = J2i '^ifi^i)^ fi^i) G ^ Ai > for every i. As is a supporting hyperplane of S at s, it 
follows that f{si) G H for every i. However, this contradicts the above fact /(si) = t ^ H. Hence the claim 
holds. □ 

As mentioned in Section II. 1[ the symmetry (or vertex-transitivity) property for convex polytopes S is 
usually defined as the transitivity of the affine isometry group of S on the vertices (extreme points) of S, 
while in our argument the members of Aut(iS) are not supposed to be isometric. However, the next result 
shows that the two kinds of symmetry are essentially the same (up to affine equivalence): 

Proposition 8. Suppose that S is compact and finite-dimensional, Aut(5) acts transitively on Sc^t, o,nd the 
unique fixed point of the Ant (S)- action is the origin ofV{S). Then there exists a bijective linear transforma- 
tion if on V{S) such that S' = <yj(5) is a compact convex subset ofV{S) with AS{S') — V{S), Aut(5') acts 
transitively on tS^xt? and each member of Ant {S') is an orthogonal linear transformation (hence an isometry) 
on V{S) with respect to the standard inner product (•, •). 

Proof. Put G — Aut(iS) which is compact. Then it is well-known from representation theory of compact 
groups that, given an inner product (•, ■) on V = V{S), the map {■,-)g '■ V x V ^ R defined by (vi,W2)g = 
• vi,g ■ V2) dg (where the right-hand side is the Haar integral) is a G-invariant inner product on V. 
Let ei, 62, . . . , e„ G V and /i, /2, ...,/« G F be orthonormal bases of V with respect to the inner products 
(•, •) and (•, •)g, respectively. Now we define a bijective linear transformation 1^ on 1^ by (p{fi) = Ci for each 
1 <i < n. Put S' — f{S). We show that this f satisfies the conditions specified in the statement. Only the 
non-trivial part of the claim is that each member of Aut(iS') is an orthogonal transformation with respect 
to (•, •). Note that Aut(5') = {ipg(p~^ \ g G G}. Moreover, we have {(p{v) , ip{w)) = {v,w)g by the choice of 
(fi, as (ifiifi), f{fj)) — (ci, Cj) — Sij — {fi, fj)G for the basis elements. Now for each g E G and v,w £V , we 
have 

{tfgip-'^{v),tpgLp-'^{w)) = {gif~'^{v),gif-'^{w))G = {^^^ {v) , ^p^^ {w)) g = {v,w) (7) 
where we used the G-invariance of (•, ■)g in the second equality. Hence the claim holds. □ 

Remark 5. It was pointed out by an anonymous referee that the fact that Aut(iS) may be assumed (up to 
affine equivalence) to consist of orthogonal transformations can be derived from the result of a paper by 
Danzer, Laugwitz and Lenz [5]. 

An easy but important consequence of the above observation is the following: 
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Corollary 5. Let S be a finite- dimensional compact convex set such that Aut(5) acts transitively on Scxt- 
Then S is affine isomorphic to the unit ball if and only if every boundary point of S is an extreme point of 
S. 

Proof. As the "only if" part is trivial, we show the "if" part. By virtue of Proposition [51 we may assume 
without loss of generality that Aut(5) acts on S as linear isometrics (with respect to the Euclidean distance on 
V{S)). This implies that every boundary point of S, which is now an extreme point of S by the assumption, 
lies in a common sphere S in V{S) with the origin as the center point, hence we have dS = S and iS is a 
ball surrounded by S, as desired. □ 

On the other hand, we present several properties for the notion of distinguishability introduced in Def- 
inition [1] First, we give a geometric interpretation of the notion of distinguishability mentioned in Section 

o 

Lemma 17. Suppose that S is finite-dimensional. Let n > 2. Then points si, S2, ■ . ■ , Sn of S are distin- 
guishable (see Definitions^ for the terminology) if and only if there exists a collection {Hi)^^^ of supporting 
hyperplanes Hi of S such that the set {ui, . . . , u„} of normal vectors Vi of Hi is linearly dependent and we 
have Si ^ Hi and Si £ Hj for every i ^ j . 

Proof. Let (•, •) denote the standard inner product on the Euclidean space V{S) = V{S). First we show the 
"only if" part. Choose the affine functionals Ci as in Definition [1] For each i, there are a non-zero vector 
Vi e V{S) and a constant q G R such that ei{s) = (u,;, s) + Ci for every s G S. As Y^^=i = 1 is constant 
on S and Aff(5) = V{S), it follows that J27=i = 0- Put H, = {v e V{S) \ e^{v) = 0}, 1 < i < n, where 
we abuse the notation to denote the affine extension of to V{S) = AS{S). Then we have Si ^ Hi 
and Si E Hj for every i ^ j, therefore Hi O S 9. As > on S, it follows that the Hi are supporting 
hyperplanes of S. Moreover, Vi is proportional to the normal vector of Hi, therefore the normal vectors of 
Hi are linearly dependent. Hence the proof of the "only if" part is concluded. 

Secondly, we show the "if" part. Choose coefficients Ai,...,A„ G R such that Y!^"^i^iVi = and at 
least one Aj is non-zero. Choose a point ti € Hi for each i. We define an affine functional Ci on V{S) by 
ei{v) = {XiVi, V — ti) for v £ V{S). We have ei{Hi) = {0} as Vi is orthogonal to Hi. On the other hand, by 
putting e = X]"=i fo'^ each v £ V(S) we have 

n n n n n 

= '^ei{v) = ^((AjWj,u) - {XiVi^ti)) = \iVi,v) - ^{X^v^,ti) = -^{X^Vi,ti) . (8) 

i—l i—1 i—1 i—1 i—1 

Put c — — J^i^iiXiVijii), therefore e is constantly equal to c. Now choose an index ig such that A^^ 7^ 0. 
Then, as Sig £ Hj and ej{Hj) — {0} for every j ^ ig, we have 6^0(3^0) — e{sig) — c. As Sig ^ Hig and 
Xig 7^ 0, we have eig{si„) — Xig{vig,Sig — tig) 7^ 0, therefore c 7^ 0. Now put = e^/c for each i. Then we 
have e'i{Hi) = {0}, Yl^=i ^'i — ^/'^ — ^ ^-ud e^(si) = ei{si)/c = e(si)/c = 1 for each i. As Hi is a supporting 
hyperplane of S and Si £ S, this implies that S is included in the closed half-space {v £ V{S) \ e^(w) > 0}, 
therefore > on S. Hence si, . . . , s„ are distinguishable, concluding the proof of Lemma [T71 □ 

Remark 6. In the situation of Lemma 1171 any proper subset of the set {vi, . . . , u„} of normal vectors of 
the hyperplanes Hi is linearly independent. Indeed, when we choose Ai, . . . , A„ G M as in the proof of that 
lemma, for each i we have ei{si) = e{si) = c 7^ 0, while ei{si) = Xi{vi, Si — ti). Therefore we have A^ 7^ for 
every i, which implies the claim. 

Now we give an upper bound of size of a collection of distinguishable points: 

Lemma 18. Suppose that S is finite- dimensional and si,...,Sk £ S are distinguishable. Then we have 
k < dim(5) -I- 1. Moreover, if in addition k = dim(5) + 1, then S is the convex hull of {sj}j^i, which is a 
dim{S)- dimensional simplex. 
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Proof. Let (ej)'j^^ be the collection of afHne functionals corresponding to {sj)^^^, therefore ei{sj) — Sij. 

Now if s = ^^'^ — 1' then we have ei{s) = J2j ^j^ii^j) — ^'^^ every i, therefore 

the decomposition of s into the points Sj is uniquely determined. Hence the points si,...,Sfe are affine 
independent, therefore k < dim(5) + 1. Moreover, ii k — dim(5) + 1, then we have V{S) = Aff(si, . . . , Sk) 
as the points si, . . . , Sfe are afhne independent, therefore each s € S admits a decomposition s = X]j=i ^j^j 
such that Xj = 1. Now we have Xj = ej(s) € [0, 1] for every j, therefore this s is contained in the convex 
hull of {si, . . . , Sk}- Hence S is the convex hull of {si, . . . , Sk}, therefore Lemma \TE\ holds. □ 

Secondly, for the notion of distinguishably (n-)decomposability introduced in Definition [21 we have the 
following two properties: 

Lemma 19. Suppose that 1 < dim(5) = n < oo and S is distinguishably n-decomposable. Then the set Scxt 
is uncountably infinite. 

Proof. Assume for contrary that 5ext is at most countable. Let B be the collection of the subsets of 5cxt 
with at most n elements, and let C be the collection of the convex hulls of B ^ B. Then each member of C 
has n-dimensional volume 0, while B (hence C) is at most countable as well as iScxt, therefore the union of all 
members of C also has n-dimensional volume 0. As the n-dimensional convex set S has positive n-dimensional 
volume, there is a point s £ S that does not belong to any member of C. However, as S is distinguishably 
n-decomposable, this s admits a convex decomposition s = X]j=i ^j^j i^to distinguishable extreme points 
si, . . . ,sg S 5cxt with £ < n, therefore B = {sj}^^]^ G B and the convex hull of B including s belongs to C. 
This is a contradiction, hence Lemma [T9l holds. □ 

Corollary 6. Suppose that S is finite- dimensional and distinguishably decomposable, and iSoxt is at most 
countable. Then S is a dmi{S) -simplex. 

Proof. By Lemma fTOl S is not distinguishably n-decomposable, where n = dini(iS), while S is distinguishably 
decomposable. This implies that there is an s e 5 that admits a convex decomposition into at least n -I- 1 
distinguishable extreme points. Therefore Lemma [15] implies that S is an n-siniplex. Hence Corollary [5] 
holds. □ 



4.2 Proof of Theorem [5] 

In this and the following subsections, we give proofs of our main theorems whose statements have been listed 
in Section ll.il In this subsection, we prove Theorem [5] 

For the "only if" part of Theorem [SJ when 5 is a finite-dimensional unit ball, it follows from Lemma [TTl 
that a subset of S of cardinality at least two is a set of distinguishable extreme points if and only if it is 
a pair of mutually antipodal points (note that now each supporting hyperplane of S contains precisely one 
point of S) . This implies that S indeed satisfies the three conditions in Theorem [5] as desired. 

On the other hand, for the "if" part of Theorem[5l it suffices by Corollary [5] to show that every boundary 
point s of 5 is an extreme point. Assume for contrary that s ^ iSoxt. Take a supporting hyperplane H of 
S at s. As S is distinguishably 2-decomposable, we have s — XiSi -\- A2S2 for some distinguishable points 
si, S2 G 5oxt and some Ai, A2 > with Ai + A2 = 1. On the other hand, by the same reason, the origin of 
V{S) (which is now an interior point of S by Lemma [T6l) also admits a decomposition = /ii^i -I- fj.2t2 into 
distinguishable points ^1,^2 G S^xt with fii, fi2 > and fJ.i-\- fi2 = 1- Now we have Si, S2 € H hy the choice of 
H and the decomposition of s. Moreover, by the second condition of Theorem[Sl there is an / G Aut(5) such 
that f{ti) = si and 7(^2) = 52- Now we have = /(O) = /^i/(ii) + /^2/(i2) = MiSi + /i2S2: while Si, S2 G -ff 
as above, therefore we have G H. This contradicts the fact that is an interior point of S. Hence we have 
s G iScxt as desired, concluding the proof of Theorem [5j 
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4.3 Proofs of Theorems [3] and [4] 



In this subsection, we give proofs of Theorems [3] and H] by assuming Theorems [T] and (5] The proofs of 
Theorems [T] and win be supphed in the next subsection. 

First, we prove Theorem [31 The imphcation of the second condition from the first one foUows from 
Theorem [TJ Theorem [S] and the fact that when 5 is a triangle, the set of the three vertices of S are 
distinguishable. For the other implication of the first condition from the second one, by virtue of Theorem 
[H it sufSces to show that any distinguishably decomposable convex polygon is a triangle, which is just a 
consequence of Corollary El Hence the proof of Theorem [3] is concluded. 

From now, we prove Theorem ID The implication of the second condition from the first one follows 
from Theorem [21 Theorem [51 and the fact that when 5 is a tetrahedron, the set of the four vertices of 
S are distinguishable. For the other implication of the first condition from the second one, by virtue of 
Theorem [2l it suffices to show that any distinguishably decomposable 3-dimensional convex polytope is a 
tetrahedron, and the 3-dimensional circular cylinder S specified in the second condition of Theorem[2lis not 
distinguishably decomposable. The first part is just a consequence of Corollary [6l For the second part, put 

= {\x,y,z) I x^+y^ = 1} for z e {0,1}. Note that 5oxt = CqUCi. We focus on the point v = *(0,0, 1/4), 
and assume for contrary that v — ^j^j fo'^ some sj S iSext and Xj > such that X]j=i ~ 1 ^^d 

si, . . . ,Sk are distinguishable (hence si, . . . , Sfc are all different). We have fc < 3 by Lemma [HI while the 
case A: < 2 is impossible by the shape of iSext = Co U Ci, therefore we have k = 3. Now the set {si, S2, S3} 
contains at least one point of each Cz, z = 0, 1. By symmetry, we may assume without loss of generality 
that si,S2 G Ci and S3 = *(1,0,0) G Cq. As si,S2,S3 are distinguishable. Lemma [T7I implies that there are 
supporting hyperplanes Hi, H2 of S such that si, S3 € Hi and S2, S3 G ^2- In particular, for each j S {1,2}, 
the line through Sj and S3 does not intersect the interior of S. However, by the shape of S, this is possible 
only when Sj — *(1,0, 1), contradicting the fact si ^ S2. Hence this S is not distinguishably decomposable, 
concluding the proof of Theorem [4l 

4.4 Proofs of Theorems [H and [2l 

Finally, in this subsection, we give proofs of Theorems [1] and [2l As the "if" part of each theorem is trivial, 
we consider the "only if" part from now. 

First, for future references, we temporarily consider the case that S is compact and finite-dimensional 
(not necessarily 2- or 3-dimensional), and Aut(5) acts transitively on Scxt- Then, by the arguments in 
Section I¥t1 we assume without loss of generality that the origin of the Euclidean space V{S) is an interior 
point of S which is the unique fixed point of the Aut(5)-action, and each member of Aut(iS) acts on V{S) 
as an orthogonal transformation (hence has determinant ±1). Now we have the following result, which will 
be a key ingredient of the proofs of the theorems: 

Lemma 20. Under the above setting, assume in addition that Aut(iS) is an infinite group. Then Aut(5) 
has an element of infinite order. 

In the proof of Lemma (201 we use the following two theorems. The first theorem is a classical affirmative 
solution for a special case of the general Burnside problem given by Schur [25] (see also e.g., \18^ Theorem 
9.9] for the proof). Recall that a group G is called periodic (or torsion) if every element of G has finite order. 
The theorem is the following: 

Theorem 7 (Schur). Let K be a field of characteristic zero, 1 < n < 00, and G be a finitely generated 
periodic subgroup of GLn{K). Then \G\ < 00. 

The second theorem was proven by Kargapolov [14] and independently by Hall and Kulatilaka |9] . Recall 
that a group G is called locally finite if every finitely generated subgroup of G has finite order. The theorem 
is the following: 

Theorem 8 (Kargapolov, and Hall-Kulatilaka). Every infinite locally finite group contains an infinite 
abelian subgroup. 
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Proof of LemmalWA Assume for contrary that G = Aut(5) has no elements of mfinite order, i.e., G is 
periodic. As G acts faithfully on V{S) as a group of orthogonal transformations, G is identified with a 
subgroup of 0„(M) (hence a subgroup of GL„(M)) where n = dim(5) < oo. Then Theorem [7] implies 
that G is locally finite, therefore Theorem [S] implies that G contains an infinite abelian subgroup H. As 
each orthogonal transformation f € H is diagonalizable over C, the members of H are simultaneously 
diagonalizable over C. Let di , . . . , w„ be the common eigenvectors of the members of H in the complexification 
V{Sf = C Oh V{S) of V{S), and let a/_i, . . . , Qf/.„ G C be the corresponding eigenvalues of / G H . As 
each / G is an orthogonal transformation, we have \afj \ = 1 for every f € H and 1 < j < n. Note that 
(a/,1 , . . . , a/,„) ^ (ctg^i , . . . , ag^n) for any distinct f,g G H. 

First, we show that there exist an index 1 < jo < n and an infinite subset Hq C H such that afjg ^ M 
and a/ Jo 7^ ctgjo distinct f,g G Hq. To prove this, we consider the following auxiliary condition, 

where d is a non-negative integer: 

There are distinct indices ji.i, ji.2, 32,1, j2,2, ■ ■ ■ , jd,i, id,2 in {l,2,...,n} and an infinite subset 
H' C H such that 0;/^^ ^ ^ M, afj^^ = ct/j^.i and a/j^ ^ = ckgj^ ^ for any 1 < £ < d and any 
distinct /, g G 

Take the maximal d > for which this condition holds (hence d < n/2). Then there are an index jd+1,1 in 
{1,2,..., n} other than . . . ,jd,2 and an infinite subset H[ C H' such that a/j^^^ ^ ^ E for every / G H'l. 
Indeed, otherwise for each index j the variation of the values ajj for f £ H' is finite (as |a/.j| = 1), so is the 
variation of {af,i, ■ ■ ■ , cuf^n), contradicting the fact that (a/^i, . . . , 7^ (o^g.ij • ■ • j Q!g^„) for any distinct 

f,g £ H' . Now for each / G H[, as / is a real transformation and a/.j^, ^ = 1 for every 1 < < d, there 
is an index j in {1, 2, . . . , n} other than ji i, . . . , jd,2, jd+1.1 such that a/j- = aJJ^^^^. As = 00, there 
are an index jd+1,2 in {1, 2, . . . ,n} other than ji 1, . . . , 2j Jd-i-1,1 and an infinite subset H2 C H[ such that 
'^fjd+i 2 ~ '^f-jd+i 1 for every / G i?2- By the maximality of d, it follows that for each / G H2, there exist at 
most a finite number of g G i?2 such that ctf.j^^^ ^ = '^sjd+i i- This implies that there is an infinite subset 
H'^ C II2 such that a/j-^^^ ^ ^ ctg,jd+i 1 distinct /, g G H!^. Now jo = jd+1,1 and iJo = -^3 satisfy the 

desired condition. 

In what follows, we write v — Vj^ and ctf — ctf.ja for each / G Hq. Put ctf = exp{2TT0 f\/—l) with 
< 9f < 1 for each / G Hq (note that aj ^ M). Then v G 1^(5)'' is an eigenvector of each / G Hq with 
eigenvalues/- By putting u = {v — v)/{2\/—l) and w = {v+v)/2, it follows that u,w G V{S), v = w + lu, 
f{u) = cos(27r6'/)M + sin(27r6'/)w and f{w) = — sin(27rf?/)w + cos(27r6'/)?i; for each / G Hq. Note that u and w 
are linearly independent over M, as w and v are linearly independent over C. As G inty(5) (5), by considering 
suitable scalar multiplication if necessary, we may assume without loss of generality that u,w £ S. On the 
other hand, as each / G Hq has finite order by the assumption, we have 9f £ Q and we can write Of = Pf /qj 
with pf and qj being coprime integers such that 1 < pf < qf ■ Then, as a/,i 7^ ag.i for any distinct /, g £ Hq 
and \Hq\ — 00, for each > there is an / G Hq such that qf > N. 

Now choose an irrational < rj < 1 (say, rj = l/\/2). Put Uoo = cos(27r?7)u + sin(27r?7)u' and Woo = 
— sin(27r?7)w + cos(27r77)-u;. Then for each integer fc > 1, there is an fk £ Hq such that qf^ > fc as above. Now 
there is an integer such that \r] — r^/qf^l < l/{2k). As pf^, and qf^, are coprime, there is an integer hk 
such that exp(27r/ii;6'/^. 1) = cxp(27rrfc-\/— ). Put gk — fk^'' £ G. Then we have 

gfe(u) = cos{2'Khk0f^)u + sin{2nhk0fj'w = cos{2'Krk/qfJu + sin{2T:rk/qfk)w , 
9k{w) = — siii{2TThkO f^)u + cos{2Trhk9 f^.)w = — siii{2Trrk/qf^)u + cos{2Trrk/qf^)w . 

As Tk/qff. converges to 77 when k — > 00, the sequences {gk{u))k>i and {gkiw))k>i converges to Uqo and 
Woo, respectively. On the other hand. Proposition [6] and Lemma fTSl implv that G is a compact metric space, 
therefore the sequence {gk)k>i in G has a subsequence {gkt)i>i that converges to some g £ G. As the G-action 
on S is continuous and u,w £ S, it follows that g{u) = \im£^ao 9k(iu) = Uoo and g{w) = Vmii^oo gktiw) = 
Woo- This implies that g^{u) — cos(27rfc?7)u + sin(27rfc?7)?i; and g^{'w) = — siii{2Trkrj)u + cos(27rfc?7)w for every 
fc > 1, therefore g^{u) ^ u as u and w are linearly independent over R and r] ^ Q. Hence g has infinite 
order, concluding the proof of Lemma [20l □ 



20 



If 5cxt is a finite set, tlien 5 is a convex polytope, which is symmetric (or vertex-transitive) by the 
assumption on the Aut(5)-action. From now, we suppose that iSoxt is an infinite set, hence Aut(5) is also 
infinite as it acts transitively on Scxt- Let / € Aut(5) be an element of infinite order whose existence 
is proven by Lemma ?IU[ We may assume without loss of generality that det(/) = 1, by considering (if 
necessary) instead of /. Now as / is an orthogonal transformation, it follows that V{S) is the orthogonal 
direct sum of the fixed point space of / and 2-dimensional /-invariant subspaces W to which the restriction 
of / is a rotation with rotation angle 2Tr9 — 2tt0w, &w G Moreover, as / has infinite order, 6 = Ow is 
irrational for at least one such subspace W . 

Now we come back to the special case for (the "only if" parts of) Theorems [1] and [5] by assuming that 
n — dim(5) G {2,3}. First we consider the case that n = 2 (for Theorem [T|). Then we have W = V{S), 
while the rotation angle of / is not a rational multiple of 27r as above, therefore the (/)-orbit of any extreme 
point of 5 is a dense subset of a circle with the origin of V{S) as center point. As iSext is compact (see 
Proposition [7]) , this circle is entirely contained in Scxt, which implies that S is the disk surrounded by this 
circle. Hence the proof of Theorem [1] is concluded. 

From now, we consider the case that n = 3 (for Theorem [J). In this case, by counting the dimension, it 
follows that V{S) is the orthogonal direct sum of 1-dimensional fixed point space of / and the 2-dimensional 
invariant space W as above. By choosing a coordinate system of V{S) = M.^ according to the decomposition, 
we assume without loss of generality that W has orthonormal basis {vi — *(l,0,0),t;2 — *(0, 1,0)} and 
vs = *(0, 0, 1) is fixed by /. Let Zmin and z^ax be the minimal and the maximal values zq G M, respectively, 
such that the plane H^g = {*{x, y,z) \ z = zq] has non-empty intersection with S. Note that Zmin < < Zmax, 
as G inty(5)(5). Note also that each is invariant under /. Now define / = {z e [zmin, -^max] | -ffzHiSext 7^ 
0}. Note that Zmin, Zmax G I- Thcn for each zq G /, as f{Hzg) = Hz„, the same argument as the case n — 2 
implies that ff^^ n Scxt = Vix, y, zq) | + = r^^} and H^^ n 5 = {*(x, y, zq) \ x'^ + y'^ < r^^} for some 

> 0. Note that rz > for every z G / \ {z,nin, Zmax}. We divide the rest of the proof into two cases. 

First, we consider the case that / {zmin, Zmax}. Then by the above argument, there are a plane H and 
a simple closed curve C such that H has non-empty intersection with the interior of S and C C H Scxt- 
Put H' = Hz^^^, which is a supporting hyperplane of S. Then, as Aut(iS) acts transitively on Scxt, there 
is a g G Aut(5) such that g{C) C Scxt has a point s common to H' D Sext- Now as g{H) has non-empty 
intersection with the interior of S as well as H, we have g{H) 7^ H' , therefore g{C) \ H' has a point s' . 
This implies that iSext contains a simple curve joining s G H' and s' ^ H', therefore we have s' G Hzg and 
[zQjZmax] C / for somc Zq < z„iax- Morcover, by the convexity of S and the above description of the set 
Hz n Scxt for z £ I, this implies further that Hz Ci dS = Hz Ci Scxt for every z G (zo,Zmax)- Therefore 
any point of Hz' n Scxt, where z' — (zq + Zniax)/2, belongs to the interior of 5ext relative to dS. As the 
Aut(5)-action is transitive on iSext and continuous on OS, it follows that every point of Scxt belongs to the 
interior of 5ext relative to dS. This implies that Scxt — dS, as dS is connected and Scxt is compact. Hence 
Corollary [5] implies that it is in the third case of Theorem [21 as desired. 

Secondly, we consider the case that / = {zmin, Zmax}, therefore 5ext C Hz^^^UHz^^^- Note that Tz^^^ > 
or ''zmax > 0, as G inty(5)(5). Now by the above description of the set Hz n iSext for z G /, it is in the 
second case of Theorem [2] if r^^^^j^^ — rz^^^. From now, we assume for contrary that rz-^^^ 7^ ^Zmax ^^.'^ deduce 
a contradiction. By symmetry, we may assume without loss of generality that r^^j^^ > r^^^^. Moreover, 
by choosing a suitable coordinate system, we may assume without loss of generality that Zmin = — 1 and 
''zmin = 1- Put Zmax — z > Q and rz-^^^ — r < \. As Aut(5) acts transitively on 5ext> there is a 5 G Aut(5) 
such that g(*(l, 0, —1)) = *(r, 0, z). Now g permutes the two connected components n5ext and fliSext 
of Scxt ■ This implies that r > and g{Hz ) = H- 1 , as Hz and 7J_ 1 are affine hulls of Hz H 5oxt and 1 n 5ext , 
respectively. Put v — *(— z,0,z). Then we have v G Hz and v = — z • *(1,0, — 1), therefore g{v) G and 
g{v) — — z • 5(*(1, 0, — 1)) = *(— rz, 0, — z^). Hence we have — z^ = —1, therefore z = 1 as z > 0. Moreover, 
as r < 1, we have v — *(— 1, 0, 1) G iJi \ 5 and g{v) — *(— r, 0, —1) G 5, a contradiction. Hence the proof of 
Theorem [5] is concluded. 
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Appendix: Fixed point of afRne automorphisms 



In this appendix, we give a proof of the fact that there exists a unique fixed point of the Aut(5)-action on S 
under the assumption that S is compact and finite-dimensional, and Aut(5) acts transitively on Scxt- First, 
we notice that the uniqueness of a fixed point is a consequence of Lemma 1161 Indeed, if two distinct fixed 
points si and S2 exist, then the Aut(5)-action fixes the line through si and S2, which contains a boundary 
point of S. This contradicts Lemma [TBI 

From now, we prove the existence of a fixed point. Take a left-invariant integral ip i— >■ Jip{g)dg on the 
compact group G ~ Aut(5), which is a linear functional on the set of real- valued continuous functions 
((5 : G — ^ R satisfying the following conditions: 

1. If (fi is non-negative, then Jip{g)dg > 0. 

2. li (fi = 1 constantly, then Jldg — J (p{g)dg — 1. 

3. If /i G G, then J if{hg)dg ~ J ip{g)dg. 

Let ifii : V{S) -> M denote the i-th coordinate function on the Euclidean space V{S). Fix a point sq E S. 
Then the map ipi : G ^ R defined by (pi{g) = ^i{g{so)) {g € G) is continuous by continuity of the G-action 
on S. Put Vi = J(pi{g)dg e M, and let v G V{S) be the unique element such that ipi{v) = Vi for every i. We 
prove that v € S and it is a fixed point of G-action. 

As V{S) — Aff(5), each / G Aut(5) extends to a bijective affine transformation on V{S), which is 
also denoted by / for simplicity. First we show that f{v) = v for every / G Aut(iS). Note that each / is 
represented by a matrix M = {Mij)ij and a vector b = {bi)i in such a way that for each x G V(S), we have 
ipi{f{x)) = Mijipj(x) + bi for every i. Now we have 



*(/(«)) = J2 ^^^J / ^i(9)dg + b^^J2 ^''3 j 'P3^9)dg + h Jldg (10) 

j j j 

where we used the property [2] above in the last equality. By the linearity, it follows that 
^^ifiv)) ^ M,^3VA9) + b}\ dg^ [(y, M,,,^,(5(so)) 





Vt{fig{so)))dg 

<?»(/ • g)dg = / ^i{g)dg = v, = ip,{v) 



(11) 



where we used the property [3] above in the last row. Hence we have ipi{f{v)) — (pi{v) for every i, therefore 
f{v) = V as desired. 

Hence it suffices to show that v E S. Assume for contrary that v ^ S. Then, as S is compact and convex, 
there exists an affine functional / on V{S) that is non-negative on S and negative at v. Choose a vector 
{mi)i and a value b such that f{x) = mjLpj{x) + b for every x E V . Then a similar argument as above 
implies that 



/(^) = XI ^0^3 ^ ^ " / ^]'Pji9{so)) + b^ dg = J 



vA9iso)) + bjdg = J f{giso))dg . (12) 

Now we have /(g(so)) > for every 5 G G by the choice of / (note that g{so) G S), therefore the right-hand 
side is non-negative by the property [T] above. On the other hand, we have f{v) < by the choice of / again. 
This is a contradiction, therefore we have f{v) G 5 as desired. Hence the claim in this appendix is concluded. 
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